Information processing apparatus, information processing method, and storage medium

ABSTRACT

An information processing apparatus in the present invention includes: an acquisition unit that acquires first history information indicating that a procedure related to boarding of a passenger in an airport was performed with biometric authentication and second history information indicating that the procedure was performed with reading of a medium; and an output unit that outputs usage status of the biometric authentication in the procedure based on the first history information and the second history information.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a Continuation of U.S. application Ser. No.16/652,612 filed Mar. 31, 2020, which is a National Stage ofInternational Application No. PCT/JP2019/031979 filed Aug. 14, 2019.

TECHNICAL FIELD

The present invention relates to an information processing apparatus, aninformation processing method, and a storage medium.

BACKGROUND ART

Patent Literature 1 discloses a ticket-less boarding system in whichbiometric information such as a face image is used as a boarding ticketto perform a procedure with the biometric information in a plurality ofprocedure areas (a security inspection site, an immigration site, aboarding gate, and the like) without a ticket medium being presented.

CITATION LIST Patent Literature

-   PTL 1: Japanese Patent Application Laid-Open No. 2007-79656

SUMMARY OF INVENTION Technical Problem

As illustrated in Patent Literature 1 as an example, in a currentairport, a passenger arbitrarily chooses either one of a method withbiometric authentication and a conventional method of causing arecording medium such as a boarding ticket to be read by a terminalapparatus and performs a procedure related to boarding on an airplane inaccordance with the chosen method. However, to improve the throughput inthe airport, there is a demand for further facilitating use of biometricauthentication by passengers.

Accordingly, in view of the problem described above, the presentinvention intends to provide an information processing apparatus, aninformation processing method, and a storage medium that can facilitateuse of biometric information in procedures related to boarding ofpassengers.

Solution to Problem

According to one example aspect of the present invention, provided is aninformation processing apparatus including: an acquisition unit thatacquires first history information indicating that a procedure relatedto boarding of a passenger in an airport was performed with biometricauthentication and second history information indicating that theprocedure was performed with reading of a medium; and an output unitthat outputs usage status of the biometric authentication in theprocedure based on the first history information and the second historyinformation.

According to another example aspect of the present invention, providedis an information processing method including: acquiring first historyinformation indicating that a procedure related to boarding of apassenger in an airport was performed with biometric authentication andsecond history information indicating that the procedure was performedwith reading of a medium; and outputting usage status of the biometricauthentication in the procedure based on the first history informationand the second history information.

According to yet another example aspect of the present invention,provided is a storage medium storing a program that causes a computer toperform: acquiring first history information indicating that a procedurerelated to boarding of a passenger in an airport was performed withbiometric authentication and second history information indicating thatthe procedure was performed with reading of a medium; and outputtingusage status of the biometric authentication in the procedure based onthe first history information and the second history information.

Advantageous Effects of Invention

According to the present invention, it is possible to provide aninformation processing apparatus, an information processing method, anda storage medium that can facilitate use of biometric authentication inprocedures related to boarding of passengers.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a block diagram illustrating a general configuration exampleof an information processing system in a first example embodiment.

FIG. 2 is a diagram illustrating one example of information stored in atoken ID information database in the first example embodiment.

FIG. 3 is a diagram illustrating one example of information stored in apassage history information database in the first example embodiment.

FIG. 4 is a diagram illustrating one example of information stored in anauthentication history information database in the first exampleembodiment.

FIG. 5 is a diagram illustrating one example of information stored in anoperation information database in the first example embodiment.

FIG. 6 is a diagram illustrating one example of information stored in areservation information database in the first example embodiment.

FIG. 7 is a block diagram illustrating one example of a hardwareconfiguration of a management server in the first example embodiment.

FIG. 8 is a block diagram illustrating one example of a hardwareconfiguration of a check-in terminal in the first example embodiment.

FIG. 9 is a block diagram illustrating one example of a hardwareconfiguration of an automatic baggage drop-off machine in the firstexample embodiment.

FIG. 10 is a block diagram illustrating one example of a hardwareconfiguration of a security inspection apparatus in the first exampleembodiment.

FIG. 11 is a block diagram illustrating one example of a hardwareconfiguration of an automated gate apparatus in the first exampleembodiment.

FIG. 12 is a block diagram illustrating one example of a hardwareconfiguration of a boarding gate apparatus in the first exampleembodiment.

FIG. 13 is a block diagram illustrating one example of a hardwareconfiguration of an operation terminal in the first example embodiment.

FIG. 14 is a sequence diagram illustrating one example of the process ina reservation system, the check-in terminal, and the management serverin the first example embodiment.

FIG. 15 is a sequence diagram illustrating one example of the process inthe automatic baggage drop-off machine and the management server in thefirst example embodiment.

FIG. 16 is a sequence diagram illustrating one example of the process inthe security inspection apparatus and the management server in the firstexample embodiment.

FIG. 17 is a sequence diagram illustrating one example of the process inthe automated gate apparatus and the management server in the firstexample embodiment.

FIG. 18 is a sequence diagram illustrating one example of the process inthe boarding gate apparatus and the management server in the firstexample embodiment.

FIG. 19 is a sequence diagram illustrating one example of the process inthe reservation system, the operation terminal, and the managementserver in the first example embodiment.

FIG. 20 is a flowchart illustrating one example of the process in themanagement server in the first example embodiment.

FIG. 21 is a diagram illustrating one example of a window output by themanagement server in the first example embodiment.

FIG. 22 is a diagram illustrating one example of a window output by themanagement server in the first example embodiment.

FIG. 23 is a diagram illustrating one example of a window output by themanagement server in the first example embodiment.

FIG. 24 is a diagram illustrating one example of a window output by themanagement server in the first example embodiment.

FIG. 25 is a diagram illustrating one example of a window output by themanagement server in the first example embodiment.

FIG. 26 is a diagram illustrating one example of a window output by themanagement server in the first example embodiment.

FIG. 27 is a schematic diagram illustrating a neural network used in alearning process in a second example embodiment.

FIG. 28 is a flowchart illustrating one example of the process in themanagement server in the second example embodiment.

FIG. 29 is a diagram illustrating one example of a window output by themanagement server in the second example embodiment.

FIG. 30 is a block diagram illustrating a general configuration exampleof an information processing apparatus in a third example embodiment.

DESCRIPTION OF EMBODIMENTS

Illustrative example embodiments of the present invention will bedescribed below with reference to the drawings. Throughout the drawings,the same components or corresponding components are labeled with thesame references, and the description thereof may be omitted orsimplified.

First Example Embodiment

FIG. 1 is a block diagram illustrating an example of the overallconfiguration of an information processing system 1 in the presentexample embodiment. The information processing system 1 is a computersystem that manages and supports an operation related to an inspectionprocedure at immigration to a user (hereafter, referred to as a“passenger”) U at an airport A. The information processing system 1 isoperated by a public institution such as an office of administration ofimmigration or a consignee consigned for the operation of theinstitution, for example. Unlike the information processing system 1, areservation system 2 is a computer system provided in an airlinecompany. The reservation system 2 includes a reservation informationdatabase 3 that manages boarding reservation information. Note that,although only one reservation system 2 is illustrated for simplifiedillustration in FIG. 1 , the reservation system 2 is provided for eachof a plurality of airline companies.

In the information processing system 1 of the present exampleembodiment, a check-in terminal 20, an automatic baggage drop-offmachine 30, a security inspection apparatus 40, an automated gateapparatus 50, and a boarding gate apparatus 60 are connected to a commonmanagement server 10 via the network NW1, respectively.

Similarly, in the reservation system 2 of each airline company, thecheck-in terminal 20, the automatic baggage drop-off machine 30, thesecurity inspection apparatus 40, the automated gate apparatus 50, andthe boarding gate apparatus 60 are connected to a server (notillustrated) via the network NW2, respectively. Operation terminals 22(32, 42, 52, 62) used by staff members S1 to S5 are connected to themanagement server 10 via the network NW1 and connected to a server ofthe reservation system 2 via the network NW2, respectively. Note thateach operation terminal 22 (32, 42, 52, 62) may be connected to thenetworks NW1 and NW2 via access points (not illustrated).

The networks NW1 and NW2 are formed of a local area network (LAN)including LAN of the airport A, a wide area network (WAN), a mobilecommunication network, or the like. The connection scheme is not limitedto a wired scheme but may be a wireless scheme. The networks NW1 and NW2are different networks from each other. That is, in the present exampleembodiment, the information processing system 1 is not directlyconnected to the reservation system 2.

The management server 10 is provided in a facility of an airport companyor the like that runs the airport A, for example. Note that themanagement server 10 may be a cloud server instead of a server installedin a facility where an operation is actually provided.

Further, the management server 10 is not necessarily required to be asingle server but may be an entity formed as a server group including aplurality of servers.

As illustrated in FIG. 1 , inspection procedures at departure from thecountry in the airport A are sequentially performed at five touch pointsP1 to P5. The relationship between respective apparatuses and the touchpoints P1 to P5 will be described below.

The check-in terminal 20 is installed in a check-in lobby (hereafter,referred to as “touch point P1”) in the airport A. The check-in terminal20 is a self-service terminal by which the user U performs a check-inprocedure (boarding procedure) by himself/herself. Further, theoperation terminal 22 is installed in a manned counter in the check-inlobby. The staff member S1 uses the operation terminal 22 in order toperform a check-in procedure of the user U. The check-in procedure is aprocedure to register information used for identifying the user U who isgoing to board an airplane. Upon completion of the procedure at thetouch point P1, the user U moves to a baggage counter or a securityinspection site.

The automatic baggage drop-off machine 30 is installed at a baggagecounter (hereafter, referred to as “touch point P2”) in the airport A.The automatic baggage drop-off machine 30 is a self-service terminalwhich is operated by the user U by himself/herself to perform aprocedure of dropping off baggage that is not carried in an airplane(baggage drop-off procedure). Further, the operation terminal 32 isinstalled in a manned baggage counter. The staff member S3 uses theoperation terminal 32 in order to perform a baggage drop-off procedureof the user U. Upon completion of the procedure at the touch point P2,the user U moves to a security inspection site. Note that, when the userU does not drop off his/her baggage, the procedure at the touch point P2is omitted.

The security inspection apparatus 40 is installed in a securityinspection site (hereafter, referred to as “touch point P3”) in theairport A. The security inspection apparatus 40 is an apparatus thatuses a metal detector to check whether or not the user U wears a metalthat may be a dangerous object. Note that the term “security inspectionapparatus” in the present example embodiment is used as a meaningincluding an X-ray inspection apparatus that uses an X-ray to checkwhether or not there is a dangerous object in carry-on baggage or thelike, a terminal apparatus of a passenger reconciliation system (PRS)that determines whether or not to permit passage of the user U at theentrance of a security inspection site, or the like without beinglimited to a metal detector. The user U who completes a check-inprocedure or an automatic baggage drop-off procedure goes through asecurity inspection procedure by the security inspection apparatus 40 inthe security inspection site. Upon completion of the procedure at thetouch point P3, the user U moves to an immigration site.

The automated gate apparatus 50 is installed in an immigration site(hereafter, referred to as “touch point P4”) in the airport A. Theautomated gate apparatus 50 is an apparatus that automatically performsan immigration procedure of the user U. Further, the operation terminal52 is installed in a manned counter in the immigration site. The staffmember S4 uses the operation terminal 52 in order to perform animmigration procedure of the user U. Upon completion of the procedure atthe touch point P4, the user U moves to a departure area in which aduty-free shop and a boarding gate are provided.

The boarding gate apparatus 60 is a passage control apparatus installedfor each boarding gate (hereafter, referred to as “touch point P5”) inthe departure area. The boarding gate apparatus 60 confirms that theuser U is a passenger of an airplane who is allowed to board via theboarding gate. Further, the operation terminal 62 is installed in amanned counter at a boarding gate. The staff member S5 uses theoperation terminal 62 in order to perform a boarding procedure for theuser U to board an airplane. Upon completion of the procedure at thetouch point P5, the user U boards the airplane and departs from thecountry.

As illustrated in FIG. 1 , the management server 10 has a token IDinformation DB 11, a passage history information DB 12, anauthentication history information DB 13, and an operation informationDB 14. Note that databases included in the management server 10 are notlimited to the above databases.

FIG. 2 is a diagram illustrating one example of information stored inthe token ID information DB 11. The token ID information DB 11 has dataitems of “token ID”, “group ID”, “feature amount”, “registered faceimage”, “token issuance time”, “token issuance device name”, “invalidflag”, and “invalidated time”. The token ID is an identifier thatuniquely identifies ID information. In the present example embodiment,the token ID is temporarily issued provided that there is a matching ina matching result between a passport face image read from a passport atthe touch point P1 and a face image obtained by capturing the user Uhaving the passport. Then, when the user U finishes a procedure at thetouch point P5 (boarding gate), the token ID is invalidated. That is,the token ID is a onetime ID having a lifetime (life cycle).

The group ID is an identifier used for grouping ID information. Thefeature amount is a value extracted from biometric information. Forexample, the same group ID is set for the user U having an accompanyingperson or the users U of a party traveler. The registered face image isa face image registered for the user U. The term of biometricinformation in the present example embodiment means a face image and afeature amount extracted from the face image. Note that the biometricinformation is not limited to a face image and a face feature amount.That is, a fingerprint image, a palm-print image, a pinna image, an irisimage, or the like may be used as the biometric information of the userU to perform biometric authentication.

The token issuance time is the time when the management server 10 issuesa token ID. The token issuance device name is a name of a device fromwhich a registered face image that triggers issuance of a token ID isacquired. The invalid flag is flag information indicating whether or notthe token ID is currently valid. Once a token ID is issued, the invalidflag becomes a value of “1” indicating that the token ID is valid.Further, once a predetermined condition is satisfied, the invalid flagis updated to a value of “0” indicating that the token ID is invalid.The invalidated time is a timestamp when the invalid flag is disabled.

FIG. 3 is a diagram illustrating one example of information stored inthe passage history information DB 12. The passage history informationDB 12 has data items of “passage history ID”, “passage touch point”,“passage time”, “device name”, “operation system type”, “token ID”,“reservation number”, and “airline code”. The passage history ID is anidentifier that uniquely identifies passage history information. Thepassage touch point corresponds to each name of the touch points P1 toP5 where the user U has passed. The passage time corresponds to eachtimestamp when the user U has passed by each of the touch points P1 toP5. The device name is a model name of an operation terminal used ineach procedure at the touch points P1 to P5. The operation system typeis a type of an operation system to which an operation terminal belongs.Note that, by extracting the passage history information on a token IDbasis, the management server 10 can recognize up to which touch pointthe user U has completed the procedure. Further, in the present exampleembodiment, the reservation number and the airline code are data itemsthat are stored instead of the token ID when a recording medium such asa boarding ticket is read to perform a procedure at a touch point. Thatis, passage history information is registered in the passage historyinformation DB 12 for both cases where the procedure at each of thetouch points P1 to P5 is performed with a method in accordance withbiometric authentication and where the procedure is performed with aconventional method of reading a recording medium.

FIG. 4 is a diagram illustrating one example of information stored inthe authentication history information DB 13. The authentication historyinformation DB 13 has data items of “authentication history ID”, “tokenID”, “authentication touch point”, “device name”, “location ID”,“authentication score”, “authentication processing time”, and“authentication result” (success/failure of biometric authentication).

The authentication history ID is an identifier that uniquely identifiesauthentication history information. The authentication touch pointcorresponds to the name of a touch point at which an authenticationprocess is performed. The device name is a model name (deviceinformation) of a terminal apparatus used in biometric authentication atthe touch points P1 to P5. The location ID is an identifier (locationinformation) that uniquely identifies respective sections in whichterminal apparatuses are arranged at the touch points P1 to P5. Notethat, since a token ID is included in authentication historyinformation, the token ID can be used as a key to acquire attributeinformation on a passenger from the operation information DB 14described later. Further, attribute information on a passenger (age,sexuality, membership category, nationality, or the like) may be storedin the authentication history information.

FIG. 5 is a diagram illustrating one example of information stored inthe operation information DB 14. The operation information DB 14 hasdata items of “token ID”, “reservation number”, “airline code”,“passenger name”, “departure place”, “destination place”, “flightnumber”, “date of flight”, “seat number”, “seat class” (for example,first class/business class/economy class), “nationality”, “passportnumber”, “family name”, “first name”, “date of birth”, “sexuality”,“membership category”, “with or without accompanying person” (forexample, an infant, a young child, a person needing a helper, or thelike), and “accompanying person category”. The reservation number is anidentifier that uniquely identifies reservation information regardingboarding to an airplane. The airline code is an identifier that uniquelyidentifies an airline company.

FIG. 6 is a diagram illustrating one example of information stored inthe reservation information DB 3.

The reservation information DB 3 has data items of “reservation number”,“airline code”, “passenger name”, “departure place”, “destinationplace”, “flight number”, “date of flight”, “seat number”, “seat class”,“nationality”, “passport number”, “family name”, “first name”, “date ofbirth”, “sexuality”, “membership category”, “with or withoutaccompanying person”, and “accompanying person category”.

In the present example embodiment, once a terminal apparatus at eachtouch point (the check-in terminal 20 or the like) reads a reservationnumber and an airline code from an airline ticket medium presented bythe user U, the terminal apparatus can inquire boarding reservationinformation from the reservation system 2 of an airline companycorresponding to the airline code based on the reservation number. Notethat a method of inquiring boarding reservation information from thereservation system 2 is not limited thereto.

Further, after a token ID and a face image of the user U are registeredin the token ID information DB 11, boarding reservation informationacquired from the reservation information DB 3 is associated with thetoken ID and registered in the operation information DB 14. Thereby, aterminal apparatus at each touch point can acquire operation informationincluding boarding reservation information from the operationinformation DB 14 by using the token ID as a key and use the acquiredoperation information in a procedure at each touch point.

Next, with reference to FIG. 7 to FIG. 13 , an example of a hardwareconfiguration of each apparatus forming the information processingsystem 1 will be described. Note that, since devices whose names are thesame but references only are different in FIG. 7 to FIG. 13 are deviceshaving a similar function, detailed description thereof will be omittedin the subsequent drawings.

FIG. 7 is a block diagram illustrating one example of a hardwareconfiguration of the management server 10. As illustrated in FIG. 7 ,the management server 10 has a central processing unit (CPU) 101, arandom access memory (RAM) 102, a storage device 103, and acommunication I/F 104. Each device is connected to a bus line 105.

The CPU 101 is a processor that has a function of performing apredetermined operation in accordance with a program stored in thestorage device 103 and controlling each component of the managementserver 10. The RAM 102 is formed of a volatile storage medium andprovides a temporary memory area required for the operation of the CPU101.

The storage device 103 is formed of a storage medium such as anonvolatile memory, a hard disk drive, or the like and functions as astorage unit. The storage device 103 stores a program executed by theCPU 101, data referenced by the CPU 101 when the program is executed, orthe like.

The communication I/F 104 is a communication interface based on astandard such as Ethernet (registered trademark), Wi-Fi (registeredtrademark), 4G, or the like, which is a module used for communicatingwith the check-in terminal 20 or the like.

FIG. 8 is a block diagram illustrating one example of a hardwareconfiguration of the check-in terminal 20. As illustrated in FIG. 8 ,the check-in terminal 20 has a CPU 201, a RAM 202, a storage device 203,a communication I/F 204, an input device 206, a display device 207, amedium reading device 208, and a biometric information acquisitiondevice 209. Each device is connected to a bus line 205.

The input device 206 is a pointing device such as a touch panel, akeyboard, or the like, for example. The display device 207 is a liquidcrystal display device, an organic light emitting diode (OLED) displaydevice, or the like and used for display of a moving image, a staticimage, a text, or the like. In the check-in terminal 20 of the presentexample embodiment, the input device 206 and the display device 207 areintegrally formed as a touch panel.

The medium reading device 208 is a device that reads a passport or anairline ticket medium of the user U and acquires information recorded onthe passport or the airline ticket. The airline ticket medium may be,for example, a paper airline ticket, a mobile terminal that displays aduplicate of an e-ticket, or the like. The medium reading device 208 isformed of a code reader, an image scanner, a contactless integratedcircuit (IC) reader, an optical character reader (OCR) device, or thelike, for example, and acquires information from various media held overthe reading unit thereof.

The biometric information acquisition device 209 is a device thatacquires a face image of the user U as biometric information of the userU. For example, the biometric information acquisition device 209 is adigital camera that captures a face of the user U standing in front ofthe check-in terminal 20, and the biometric information acquisitiondevice 209 captures a face of the user U and acquires a face image.

FIG. 9 is a block diagram illustrating one example of a hardwareconfiguration of the automatic baggage drop-off machine 30. Asillustrated in FIG. 9 , the automatic baggage drop-off machine 30 has aCPU 301, a RAM 302, a storage device 303, a communication I/F 304, aninput device 306, a display device 307, a medium reading device 308, abiometric information acquisition device 309, a baggage transport device310, and an output device 311. Each device is connected to a bus line305.

The baggage transport device 310 transports baggage of the user U inorder to load the baggage to an airplane that the user U is boardingwhen the identity verification of the user U is successful. The baggagetransport device 310 transports baggage that is placed on a receptionpart by the user U and attached with a baggage tag to a cargo handlingsection.

The output device 311 is a device that outputs a baggage tag to beattached to dropped-off baggage. Further, the output device 311 outputsa baggage claim tag required for claiming baggage after arriving at thedestination. Note that a baggage tag or a baggage claim tag isassociated with at least one of passport information and boardinginformation.

FIG. 10 is a block diagram illustrating one example of a hardwareconfiguration of the security inspection apparatus 40. As illustrated inFIG. 10 , the security inspection apparatus 40 has a CPU 401, a RAM 402,a storage device 403, a communication I/F 404, an input device 406, adisplay device 407, a medium reading device 408, a biometric informationacquisition device 409, and a metal detector gate 410. Each device isconnected to a bus line 405.

The metal detector gate 410 is a gate type metal detector and detects ametal worn by the user U passing through the metal detector gate 410.

FIG. 11 is a block diagram illustrating one example of a hardwareconfiguration of the automated gate apparatus 50. The automated gateapparatus 50 has a CPU 501, a RAM 502, a storage device 503, acommunication I/F 504, an input device 506, a display device 507, amedium reading device 508, a biometric information acquisition device509, and a gate 511. Each device is connected to a bus line 505. Notethat the automated gate apparatus 50 is arranged in the entry inspectionsite has the same hardware as the automated gate apparatus 50 arrangedin the immigration site.

The gate 511 transitions from a closed state to block passage of theuser U during standby to an opened state to permit passage of the user Uunder the control of the CPU 501 when identity verification of the userU at the automated gate apparatus 50 is successful and the user U passesthrough immigration. The scheme of the gate 511 is not particularlylimited and may be, for example, a flapper gate whose flapper providedon one side of the pathway or flappers provided on both sides of thepathway are opened and closed, a turn style gate whose three barsrotate, or the like.

FIG. 12 is a block diagram illustrating one example of a hardwareconfiguration of the boarding gate apparatus 60. As illustrated in FIG.12 , the boarding gate apparatus 60 has a CPU 601, a RAM 602, a storagedevice 603, a communication I/F 604, an input device 606, a displaydevice 607, a biometric information acquisition device 609, and a gate611. Each device is connected to a bus line 605.

FIG. 13 is a block diagram illustrating one example of a hardwareconfiguration of each of the operation terminals 22, 32, 42, 52, and 62.As illustrated in FIG. 13 , the operation terminal 22 has a CPU 221, aRAM 222, a storage device 223, a communication I/F 224, an input device226, a display device 227, and a medium reading device 228. Each deviceis connected to a bus line 225. Note that each hardware configuration ofthe operation terminals 32, 42, 52, and 62 is the same as that of theoperation terminal 22.

Next, the operation of each apparatus in the information processingsystem 1 in the present example embodiment will be described based onFIG. 14 to FIG. 26 .

[Check-In Procedure]

FIG. 14 is a sequence diagram illustrating one example of the process inthe reservation system 2, the check-in terminal 20, and the managementserver 10. This process is performed every time the user U uses thecheck-in terminal 20 to perform a check-in procedure.

First, the check-in terminal 20 determines whether or not a passport ofthe user U is held over a reading unit (not illustrated) of the mediumreading device 208 (step S101) and stands by until a passport is heldover (step S101, NO).

Next, if it is determined that a passport is held over the reading unitof the medium reading device 208 (step S101, YES), the check-in terminal20 acquires passport information on the user U from the passport that isheld over (step S102). The acquired passport information includes apassport face image of the user U, identity verification information, apassport number, information on a passport issuance country, or thelike.

Next, the check-in terminal 20 captures a face of the user U by usingthe biometric information acquisition device 209 (step S103) andtransmits the face image, the passport information, and the deviceinformation and the location information of the check-in terminal 20 tothe management server 10 (step S104). Note that it is preferable todisplay a window used for obtaining consent of the user U beforecapturing a face image.

In response to receiving information from the check-in terminal 20, themanagement server 10 matches, at 1:1, a face image recorded on thepassport of the user U (hereafter, referred to as “passport face image”)with a face image captured by the check-in terminal 20 (hereafter,referred to as “target face image”) (step S105).

Next, the management server 10 issues an authentication history ID andregisters, in the authentication history information DB 13,authentication history information in which an authentication historyID, an authentication score, an authentication processing time, and anauthentication result are associated (step S106).

Next, if it is determined that the matching result between the passportface image and the target face image indicates a successful matching(step S107, YES), the management server 10 issues a token ID (stepS108). The token ID is set to a unique value based on date and time or asequence number at a process, for example.

Next, the management server 10 uses the target face image as aregistered face image and registers the relationship between the tokenID and the registered face image in the token ID information DB 11 (stepS109).

Further, the management server 10 updates the authentication historyinformation DB 13 in order to add the token ID to the authenticationhistory of the matched user U (step S110).

In the present example embodiment, the reason why a face image capturedon site (target face image) is used as the registered face image is thatthe lifecycle of a token ID is terminated within the day, that acaptured image is closer to an image captured in the subsequentauthentication process than a passport face image in a quality(appearance), or the like. However, a passport face image may be set asa registered face image (registered biometric information) instead of atarget face image (captured face image). For example, when a lifecycleof a token ID spans a long term (for example, when a token ID isvalidated for a certain lifecycle if the user U has a membership, or thelike in airline services), a face image of a passport or a license cardmay be set as a registered face image.

Next, the management server 10 transmits the issued token ID and thematching result of a successful matching to the check-in terminal 20(step S111).

On the other hand, if it is determined that the matching result betweenthe passport face image and the target face image indicates anunsuccessful matching (step S107, NO), the management server 10transmits the matching result of the unsuccessful matching to thecheck-in terminal 20 (step S112).

Next, based on the matching result of the successful matching receivedfrom the management server 10, if the check-in terminal 20 determinesthat the check-in procedure can be performed (step S113, YES), theprocess proceeds to step S114. Contrarily, based on the matching resultof the unsuccessful matching received from the management server 10, ifthe check-in terminal 20 determines that the check-in procedure is notperformed (step S113, NO), the check-in terminal 20 notifies the user Uof an error message (step S115).

In step S114, the check-in terminal 20 determines whether or not anairline ticket medium of the user U is held over the reading unit of themedium reading device 208. The check-in terminal 20 stands by until anairline ticket medium is held over (step S114, NO).

Next, if it is determined that an airline ticket medium is held over thereading unit of the medium reading device 208 (step S114, YES), thecheck-in terminal 20 acquires recorded data such as a reservationnumber, an airline code, and the like from the airline ticket mediumthat is held over (step S116).

Next, the check-in terminal 20 transmits the recorded data to thereservation system 2 of an airline company corresponding to the airlinecode (step S117) and requests matching between the recorded data andboarding reservation information.

In response to receiving recorded data from the check-in terminal 20,the reservation system 2 matches the recorded data with boardingreservation information stored in the reservation information DB 3 (stepS118) and transmits the matching result to the check-in terminal 20(step S119).

Next, in response to receiving the matching result of a successfulmatching from the reservation system 2, the check-in terminal 20performs a check-in procedure such as confirmation of an itinerary,selection of a seat, or the like based on the input information on theuser U (step S120). If there is no matching in the matching result inthe reservation system 2, the check-in terminal 20 may notify the user Uof an error without performing a check-in procedure. The check-interminal 20 then transmits, to the management server 10, a token ID,operation information, and passage history information indicatingcompletion of procedure at the check-in terminal 20 (step S121).Further, the passage history information includes information such asthe passage time at the touch point P1, the device name of a terminalused for the procedure, or the like.

Next, in response to receiving the information from the check-interminal 20, the management server 10 registers passage historyinformation indicating a relationship between the token ID and thepassage information at the touch point P1 in the passage historyinformation DB 12 (step S122). The management server 10 then registersthe operation information including the boarding reservation informationreceived from the check-in terminal 20 in the operation information DB14 (step S123).

As described above, a target face image (captured face image)successfully matched with a passport face image acquired from a passportin a check-in procedure is registered in the token ID information DB 11as a registered face image, and a registered face image and operationinformation in the operation information DB 14 are associated with eachother by the issued token ID. This enables biometric authentication byusing face matching between a captured face image and a registered faceimage at each subsequent touch point.

[Baggage Drop-Off Procedure]

FIG. 15 is a sequence diagram illustrating one example of the process inthe automatic baggage drop-off machine 30 and the management server 10.This process is performed when the user U who completed the check-inprocedure makes a baggage drop-off procedure if necessary.

The automatic baggage drop-off machine 30 continuously or periodicallycaptures the area in front of the apparatus and determines whether ornot a face of the user U standing in front of the automatic baggagedrop-off machine 30 is detected in the captured image (step S201). Theautomatic baggage drop-off machine 30 stands by until a face of the userU is detected in an image by the biometric information acquisitiondevice 309 (step S201, NO).

If it is determined that a face of the user U is detected by thebiometric information acquisition device 309 (step S201, YES), theautomatic baggage drop-off machine 30 captures the face of the user Uand acquires the face image of the user U as a target face image (stepS202).

Next, the automatic baggage drop-off machine 30 transmits the targetface image of the user U captured by the biometric informationacquisition device 309 and the device information and the locationinformation of the automatic baggage drop-off machine 30 to themanagement server 10 together with a matching request (step S203).Thereby, the automatic baggage drop-off machine 30 requests themanagement server 10 to match, at 1:N, the target face image of the userU captured by the biometric information acquisition device 309 with aplurality of registered face images registered in the token IDinformation DB 11 of the management server 10.

In response to receiving the information such as the target face imageand the matching request from the automatic baggage drop-off machine 30,the management server 10 performs matching of the face image of the userU (step S204). That is, the management server 10 matches, at 1:N, thetarget face image received from the automatic baggage drop-off machine30 with a plurality of registered face images registered in the token IDinformation DB 11. Note that the registered face images to be matchedare limited to images associated with the token ID whose invalid flaghas a value of “1” (valid).

Next, the management server 10 issues an authentication history ID andregisters, in the authentication history information DB 13,authentication history information in which the authentication historyID, the device information, the location information, the authenticationscore, the authentication processing time, and the authentication resultare associated (step S205). Note that, if the matching result in stepS204 indicates a successful matching, since the token ID associated withthe successfully matched registered face image can be identified, thetoken ID is included in the authentication history information.

Herein, if the management server 10 determines that the matching resultindicates an unsuccessful matching (step S206, NO), the managementserver 10 transmits the unsuccessful matching result to the automaticbaggage drop-off machine 30 (step S209), and the process proceeds tostep S210. Contrarily, if the management server 10 determines that thematching result indicates a successful matching (step S206, YES), theprocess proceeds to step S207.

In step S207, the management server 10 acquires boarding reservationinformation such as a reservation number or the like from the operationinformation DB 14 by using, as a key, the token ID associated with thesuccessfully matched registered face image in the token ID informationDB 11. The management server 10 then transmits the token ID, theboarding reservation information, and the matching result to theautomatic baggage drop-off machine 30 (step S208).

Next, if the automatic baggage drop-off machine 30 determines based onthe matching result that the procedure can be performed (step S210,YES), the process proceeds to step S212.

Contrarily, if it is determined based on the matching result that theprocedure is not performed (step S210, NO), the automatic baggagedrop-off machine 30 notifies the user U of an error message (step S211).

In step S212, the automatic baggage drop-off machine 30 performs theprocess of a baggage drop-off procedure of the user U based on theboarding reservation information received from the management server 10.

Next, the automatic baggage drop-off machine 30 transmits, to themanagement server 10, the token ID, the operation information, andpassage history information indicating that the baggage drop-offprocedure of the user U completed after the matching of the face image(step S213). Note that the passage history information includesinformation such as the passage time at the touch point P2, the devicename of the used terminal, or the like.

In response to receiving the information from the automatic baggagedrop-off machine 30, the management server 10 registers, in the passagehistory information DB 12, passage history information indicating therelationship between the token ID and the passage information at thetouch point P2 on the user U (step S214). The management server 10 thenregisters the operation information received from the automatic baggagedrop-off machine 30 in the operation information DB 14 if necessary(step S215).

[Security Inspection Procedure]

FIG. 16 is a sequence diagram illustrating one example of the process inthe security inspection apparatus 40 and the management server 10. Thisprocess is performed when the user U who completed a check-in procedureor a baggage drop-off procedure goes through a security inspectionprocedure.

The security inspection apparatus 40 continuously or periodicallycaptures the front area of the metal detector gate 410 and determineswhether or not a face of the user U standing in front of the metaldetector gate 410 is detected in a captured image (step S301). Thesecurity inspection apparatus 40 stands by until a face of the user U isdetected in an image by the biometric information acquisition device 409(step S301, NO).

If it is determined that a face of the user U is detected by thebiometric information acquisition device 409 (step S301, YES), thesecurity inspection apparatus 40 captures the face of the user U andacquires the face image of the user U as a target face image (stepS302).

Next, the security inspection apparatus 40 transmits the target faceimage of the user U captured by the biometric information acquisitiondevice 409 and the device information and the location information ofthe security inspection apparatus 40 to the management server 10together with a matching request (step S303). Thereby, the securityinspection apparatus 40 requests the management server 10 to match, at1:N, the target face image of the user U captured by the biometricinformation acquisition device 409 with a plurality of registered faceimages registered in the token ID information DB 11 of the managementserver 10.

In response to receiving the target face image, the matching request,and the like from the security inspection apparatus 40, the managementserver 10 performs matching of the face image of the user U (step S304).That is, the management server 10 matches, at 1:N, the target face imagereceived from the security inspection apparatus 40 with a plurality ofregistered face images registered in the token ID information DB 11.Note that the registered face images to be matched are limited to imagesassociated with the token ID whose invalid flag has a value of “1”(valid).

Next, the management server 10 issues an authentication history ID andregisters, in the authentication history information DB 13,authentication history information in which the authentication historyID, the device information, the location information, the authenticationscore, the authentication processing time, and the authentication resultare associated (step S305). Note that, if the matching result in stepS304 indicates a successful matching, since the token ID associated withthe successfully matched registered face image can be identified, theauthentication history information includes the token ID.

Herein, if the management server 10 determines that the matching resultindicates an unsuccessful matching (step S306, NO), the managementserver 10 transmits the matching result of the unsuccessful matching tothe security inspection apparatus 40 (step S309), and the processproceeds to step S310. Contrarily, if the management server 10determines that the matching result indicates a successful matching(step S306, YES), the process proceeds to step S307.

In step S307, the management server 10 acquires boarding reservationinformation such as a reservation number from the operation informationDB 14 by using, as a key, the token ID associated with the successfullymatched registered face image in the token ID information DB 11. Themanagement server 10 then transmits the token ID, the boardingreservation information, and the matching result to the securityinspection apparatus 40 (step S308). The process proceeds to step S310.

Next, if the security inspection apparatus 40 determines based on thematching result that the procedure can be performed (step S310, YES),the process proceeds to step S312.

Contrarily, if it is determined based on the matching result that theprocedure is not performed (step S310, NO), the security inspectionapparatus 40 notifies the user U of an error message (step S311).

Next, the security inspection apparatus 40 performs the securityinspection process on the user U based on the boarding reservationinformation received from the management server 10 (step S312). In thesecurity inspection process, the CPU 401 controls each component of thesecurity inspection apparatus 40. Thereby, the security inspectionapparatus 40 detects a metal worn by the user U passing through themetal detector gate 410. The user U who has passed through the metaldetector gate 410 moves to an immigration site.

Next, the security inspection apparatus 40 transmits, to the managementserver 10, the token ID, the operation information, and passage historyinformation indicating that the security inspection procedure of theuser U completed after the matching of the face image (step S313). Notethat the passage history information includes information such as thepassage time at the touch point P3, the device name of the usedterminal, or the like.

In response to receiving the information from the security inspectionapparatus 40, the management server 10 registers, in the passage historyinformation DB 12, passage history information indicating therelationship between the token ID and the passage information at thetouch point P3 on the user U (step S314). The management server 10 thenregisters the operation information received from the securityinspection apparatus 40 in the operation information DB 14 if necessary(step S315)

[Immigration Procedure]

FIG. 17 is a sequence diagram illustrating one example of the process inthe automated gate apparatus 50 and the management server 10.

The user U who completed the security inspection procedure moves to theimmigration site and goes through an immigration procedure at theautomated gate apparatus 50. The automated gate apparatus 50 and themanagement server 10 perform the process illustrated in FIG. 17 everytime each of a plurality of users U is subjected to the immigrationprocedure.

The automated gate apparatus 50 continuously or periodically capturesthe front area of the automated gate apparatus 50 and determines whetheror not a face of the user U standing in front of the automated gateapparatus 50 is detected in a captured image (step S401). The automatedgate apparatus 50 stands by until a face of the user U is detected in animage by the biometric information acquisition device 509 (step S401,NO).

If it is determined that a face of the user U is detected by thebiometric information acquisition device 509 (step S401, YES), theautomated gate apparatus 50 captures the face of the user U and acquiresthe face image of the user U as a target face image (step S402).

Next, the automated gate apparatus 50 transmits the target face image ofthe user U captured by the biometric information acquisition device 509and the device information and the location information of the automatedgate apparatus 50 to the management server 10 together with a matchingrequest (step S403). Thereby, the automated gate apparatus 50 requeststhe management server 10 to match, at 1:N, the target face image of theuser U captured by the biometric information acquisition device 509 witha plurality of registered face images registered in the token IDinformation DB 11 of the management server 10.

In response to receiving the target face image, the matching request,and the like from the automated gate apparatus 50, the management server10 performs matching of the face image of the user U (step S404). Thatis, the management server 10 matches, at 1:N, the target face imagereceived from the automated gate apparatus 50 with a plurality ofregistered face images registered in the token ID information DB 11.Note that the registered face images to be matched are limited to imagesassociated with the token ID whose invalid flag has a value of “1”(valid).

Next, the management server 10 issues an authentication history ID andregisters, in the authentication history information DB 13,authentication history information in which the authentication historyID, the device information, the location information, the authenticationscore, the authentication processing time, and the authentication resultare associated (step S405). Note that, if the matching result in stepS404 indicates a successful matching, since the token ID associated withthe successfully matched registered face image can be identified, theauthentication history information also includes the token ID.

If the management server 10 determines that the matching resultindicates an unsuccessful matching (step S406, NO), the managementserver 10 transmits the matching result indicating an unsuccessfulmatching to the automated gate apparatus 50 (step S409), and the processproceeds to step S410. Contrarily, if the management server 10determines that the matching result indicates a successful matching(step S406, YES), the process proceeds to step S407.

In step S407, the management server 10 acquires boarding reservationinformation such as a reservation number from the operation informationDB 14 by using, as a key, the token ID associated with the successfullymatched registered face image in the token ID information DB 11. Themanagement server 10 then transmits the token ID, the boardingreservation information, and the matching result to the automated gateapparatus 50 (step S408). The process proceeds to step S410.

Next, if the automated gate apparatus 50 determines based on thematching result that the procedure can be performed (step S410, YES),the process proceeds to step S412. Contrarily, if the automated gateapparatus 50 determines based on the matching result that the procedureis not performed (step S410, NO), the automated gate apparatus 50notifies the user U of an error message (step S411). For example, anotification window including a message such as “Please move toimmigration procedure at the manned counter” is displayed on the displaydevice 507.

Next, the automated gate apparatus 50 performs an immigration procedureof the user U based on the boarding reservation information receivedfrom the management server 10 (step S412) and opens the gate 511 (stepS413). The user U who has passed through the touch point P4 moves to adeparture area in which a boarding gate is provided.

Next, the automated gate apparatus 50 transmits, to the managementserver 10, the token ID, the operation information, and passage historyinformation indicating that the immigration procedure of the user Ucompleted after the matching of the face image (step S414). Note thatthe passage history information includes information such as the passagetime at the touch point P4, the device name of the used terminal, or thelike.

In response to receiving the information from the automated gateapparatus 50, the management server 10 registers, in the passage historyinformation DB 12, passage history information indicating therelationship between the token ID and the passage information at thetouch point P4 on the user U (step S415). The management server 10 thenregisters the operation information received from the automated gateapparatus 50 in the operation information DB 14 if necessary (stepS416).

[Boarding Check at Boarding Gate]

FIG. 18 is a sequence diagram illustrating one example of the process inthe boarding gate apparatus 60 and the management server 10. Thisprocess is performed when the user U passes through a boarding gate.

The boarding gate apparatus 60 continuously or periodically captures thefront area of the apparatus and determines whether or not a face of theuser U standing in front of the boarding gate apparatus 60 is detectedin a captured image (step S501). The boarding gate apparatus 60 standsby until a face of the user U is detected in an image by the biometricinformation acquisition device 609 (step S501, NO).

If it is determined that a face of the user U is detected by thebiometric information acquisition device 609 (step S501, YES), theboarding gate apparatus 60 captures the face of the user U and acquiresthe face image of the user U as a target face image (step S502).

Next, the boarding gate apparatus 60 transmits the target face image ofthe user U captured by the biometric information acquisition device 609and the device information and the location information of the boardinggate apparatus 60 to the management server 10 together with a matchingrequest (step S503). Thereby, the boarding gate apparatus 60 requeststhe management server 10 to match, at 1:N, the target face image of theuser U captured by the biometric information acquisition device 609 witha plurality of registered face images registered in the token IDinformation DB 11 of the management server 10.

In response to receiving the target face image, the matching request,and the like from the boarding gate apparatus 60, the management server10 performs matching of the face image of the user U (step S504). Thatis, the management server 10 matches, at 1:N, the target face imagereceived from the boarding gate apparatus 60 with a plurality ofregistered face images registered in the token ID information DB 11.Note that the registered face images to be matched are limited to imagesassociated with the token ID whose invalid flag has a value of “1”(valid).

Next, the management server 10 issues an authentication history ID andregisters, in the authentication history information DB 13,authentication history information in which the authentication historyID, the device information, the location information, the authenticationscore, the authentication processing time, and the authentication resultare associated (step S505). Note that, if the matching result in stepS504 indicates a successful matching, since the token ID associated withthe successfully matched registered face image can be identified, theauthentication history information includes the token ID.

If the management server 10 determines that the matching resultindicates an unsuccessful matching (step S506, NO), the managementserver 10 transmits the matching result indicating an unsuccessfulmatching to the boarding gate apparatus 60 (step S509), and the processproceeds to step S510. Contrarily, if the management server 10determines that the matching result indicates a successful matching(step S506, YES), the process proceeds to step S507.

In step S507, the management server 10 acquires boarding reservationinformation such as a reservation number from the operation informationDB 14 by using, as a key, the token ID associated with the successfullymatched registered face image in the token ID information DB 11. Themanagement server 10 then transmits the token ID, the boardingreservation information, and the matching result to the boarding gateapparatus 60 (step S508). The process proceeds to step S510.

Next, if the boarding gate apparatus 60 determines based on the matchingresult that the procedure can be performed (step S510, YES), the processproceeds to step S512.

Contrarily, if the boarding gate apparatus 60 determines based on thematching result that the procedure is not performed (step S510, NO), theboarding gate apparatus 60 notifies the user U of an error message (stepS511). For example, the boarding gate apparatus 60 displays anotification window including a message such as “Please move toprocedure at the manned counter” on the display device 607.

In step S512, in response to receiving the boarding reservationinformation from the reservation system 2, the boarding gate apparatus60 performs check for boarding of the user U based on the flight number,the gate number, the boarding start time, and the like included in theboarding reservation information. When permitting the boarding, theboarding gate apparatus 60 opens the gate 611 (step S513). The user Uwho has passed through the touch point P5 boards an airplane. Note that,if the boarding gate apparatus 60 determines not to permit boarding instep S512, it is preferable to notify the user U of an error messagewithout opening the gate 611. For example, the gate 611 is not openedwhen the user U makes a mistake in the number of the gate 611, when thecurrent time is before the time to the boarding start time, or the like.

Next, the boarding gate apparatus 60 transmits, to the management server10, the token ID, the operation information, and passage historyinformation indicating that the user U completed the boarding on theairplane after the matching of the face image (step S514). Note that thepassage history information includes information such as the passagetime at the touch point P5, the device name of the used terminal, or thelike.

In response to receiving the information from the boarding gateapparatus 60, the management server 10 registers, in the passage historyinformation DB 12, passage history information indicating therelationship between the token ID and the passage information at thetouch point P5 on the user U (step S515). The management server 10 thenregisters the operation information received from the boarding gateapparatus 60 in the operation information DB 14 if necessary (stepS516).

The management server 10 then updates the token ID information DB 11(step S517). Specifically, the management server 10 updates the invalidflag in the token ID information DB 11 to a value of invalidity (“0”).Thereby, the lifecycle of the token ID expires.

[Procedure by Method Other than Biometric Authentication]

FIG. 19 is a sequence diagram illustrating one example of the process inthe reservation system 2, the operation terminal 22, and the managementserver 10. This process is performed when each of the staff members (S1to S5) uses the operation terminal 22 or the like to perform aprocedure. Herein, the operation terminal 22 arranged at the touch pointP1 will be described as an example.

First, the operation terminal 22 determines whether or not a passport ofthe user U is held over a reading unit (not illustrated) of the mediumreading device 228 (step S601) and stands by until a passport is heldover (step S601, NO).

Next, if it is determined that a passport is held over the reading unitof the medium reading device 228 (step S601, YES), the operationterminal 22 acquires passport information on the user U from thepassport that is held over (step S602). The acquired passportinformation includes a passport face image of the user U, identityverification information, a passport number, information on a passportissuance country, or the like.

Next, the operation terminal 22 determines whether or not an airlineticket medium of the user U is held over a reading unit of the mediumreading device 228 (step S603). The operation terminal 22 stands byuntil an airline ticket medium is held over (step S603, NO).

Next, if it is determined that an airline ticket medium is held over thereading unit of the medium reading device 228 (step S603, YES), theoperation terminal 22 acquires recorded data such as a reservationnumber and an airline code from the airline ticket medium that is heldover (step S604).

Next, the operation terminal 22 transmits the recorded data to thereservation system 2 of an airline company corresponding to the airlinecode (step S605) and requests matching of the recorded data with theboarding reservation information.

In response to receiving the recorded data from the operation terminal22, the reservation system 2 matches the recorded data with the boardingreservation information recorded in the reservation information DB3(step S606) and transmits the matching result to the operation terminal22 (step S607).

Next, in response to receiving the matching result from the reservationsystem 2, the operation terminal 22 determines whether or not theprocedure at the touch point P1 can be performed (step S608). Herein, ifthe operation terminal 22 determines that the procedure can be performed(step S608, YES), the process proceeds to step S609. Contrarily, basedon the information received from the management server 10, if theoperation terminal 22 determines that the procedure is not performed(step S608, NO), the operation terminal 22 provides a notification of anerror message (step S610).

In step S609, the operation terminal 22 performs an inspection procedure(check-in procedure) at the touch point P1 based on information input bythe staff member S. The operation terminal 22 transmits, to themanagement server 10, the reservation number, the operation informationobtained by the process at the operation terminal 22, and the passagehistory information indicating completion of the procedure at theoperation terminal 22 (step S611).

Next, in response to receiving the information from the operationterminal 22, the management server 10 registers the passage historyinformation in the passage history information DB 12 (step S612). Themanagement server 10 then registers the operation information receivedfrom the operation terminal 22 in the operation information DB 14 ifnecessary (step S613).

[Statistics Analysis Process]

FIG. 20 is a flowchart illustrating one example of the process in themanagement server 10. This process is performed in a predetermined cycleor when a process request is input by a manager of the system or thelike.

First, in response to acquiring a statistics analysis condition set bythe manager or the like (step S701), the management server 10 acquirespassage history information of a specified period based on thestatistics analysis condition from the passage history information DB 12(step S702). Note that, when a procedure is performed with reading of arecording medium at each of the touch points P1 to P5, passage historyinformation including no token ID is acquired from the passage historyinformation DB 12.

Next, the management server 10 acquires authentication historyinformation at the time of passage at a touch point from theauthentication history information DB 13 by using the token ID includedin the passage history information as a key (step S703).

Next, the management server 10 acquires operation information includingattribute information on the user U from the operation information DB 14by using the token ID included in the passage history information as akey (step S704).

Next, the management server 10 performs a statistics analysis process onthe passage history information, the authentication history information,and the operation information (attribute information) (step S705). Themanagement server 10 performs a statistics process for each touch point,for each attribute of the user U, or for each period, for example.

Then, in response to acquiring a display condition for a statisticsanalysis result designated by the manager or the like (step S706), themanagement server 10 displays the statistics analysis result on theoperation terminal 22 or a terminal used for display (not illustrated)(step S707).

FIG. 21 to FIG. 26 are diagrams illustrating one example of a windowoutput by the management server 10. FIG. 21 illustrates an analysis menuselection window used on which a system manager selects an analysisresult to be displayed. In the center region of the window, a pluralityof analysis menus M1 to M6 and an analysis condition set button M7 bywhich the window is changed to a window used for setting an analysiscondition are displayed.

FIG. 22 is a dashboard window in which different types of statisticsresults are displayed all together in a dashboard form. The dashboardwindow illustrated in FIG. 21 is substantially formed of four regions A1to A4. The region A1 indicates results in which the authenticationaccuracy is statistically analyzed for each location.

The region A1 is formed of regions A11 to A14. The region A11 displaysthe average authentication accuracy, the average authentication time,and the token ID usage rate for a location (“T1 South W”). The “token IDusage rate” has the same meaning as a usage rate of biometricauthentication. Addition of the number of records of history information(first history information) on a procedure with biometric authentication(that is, the number of users of biometric authentication) N1 and thenumber of records of usage information on a procedure with reading ofthe recording medium (that is, the number of users of a medium) N2results in the total number of passengers N3. Thus, when the token IDusage rate is denoted as R, R=N1/(N1+N2) can be calculated.

The region A12 displays the average authentication accuracy on aterminal ID basis. The region A13 displays the average authenticationtime on a terminal ID basis. The region A14 displays the token ID usagerate on a terminal ID basis. Note that, in A12 to A14, the locations ofthe terminal ID of “#51” to “#54” are “T1 South W”, and the locations ofthe terminal ID of “#61” to “#64” are “T2 Main building”.

In the region A11, the region A12, and the region A13, a terminal whichdoes not satisfy a predetermined threshold may be detected and displayedwith emphasis.

For example, in the region A12, the terminal whose terminal ID is “#52”can be detected as a terminal in which the average authenticationaccuracy is less than a threshold of 0.96. Further, process results ofbiometric authentication (authentication accuracy, authentication time,and authentication success rates) may be aggregated and output on alocation basis. Then, when the average authentication accuracy on alocation (arrangement place) basis does not satisfy a predeterminedthreshold, the information on such a location may be output.

In the region A13, the terminal whose terminal ID is “#52” can bedetected as a terminal in which the average authentication time exceedsa threshold of 1 second. Similarly, when the authentication successrates are displayed on a terminal basis in the region A1, a terminal inwhich the authentication success rate is less than a predeterminedthreshold can be detected and displayed with emphasis.

The region A2 indicates results obtained by statistically analyzing thedistribution status of the number of staying passengers for eachlocation. The region A2 is formed of a region A21 and a region A22. Theregion A21 displays the number of passing passengers in a form of a piegraph. The region A22 displays the number of expected staying passengersin a form of a pie graph.

The region A3 indicates results obtained by statistically analyzing theaverage passage time and the throughput of a terminal for each device.The region A3 is formed of a region A31 and a region A32. The region A31displays the average passage time on a terminal ID basis in a form of abar graph. The region A32 displays the throughput on a terminal ID basisin a form of a bar graph.

The region A4 indicates results obtained by statistically analyzing thenumber of passengers for each time zone. In the region A4, the number ofpassengers is categorized by before and after the security inspectionsite (PRS) and by location in the touch point P3 (T1 South W Satellite4/T1 South W Satellite 5/T2 Main building/T2 Satellite). Further, theregion A4 is formed of the regions A41 and A42. The region A41 displaysthe number of passengers for each time zone in two locations (T1 South WSatellite 4/T2 Main building). Further, the region A42 displays data ofchange in the number of passengers for each time zone and for eachlocation with eight types of polygonal lines.

FIG. 23 is a window for change in the number of token ID registrantsillustrating a change in the number of registrants of token IDs. In theupper part of the window, a button B11 used for switching the statisticsperiod of data between a yearly basis, a monthly basis, and a dailybasis and a button B12 used for outputting a statistics result as a CSVfile are displayed. In this example, the button B11 of a yearly basis isselected. Further, in the center part of the window, the number ofregistrants in a period of years from 2018 to 2019 is displayed in a bargraph, and the numbers of registrants for respective touch points aredisplayed in a polygonal line graph and a list table. Note that,although FIG. 23 displays all the legends, it is possible to provide abutton used for selecting a touch point and display only the change inthe number of registrants for the selected touch point.

FIG. 24 is a window for attribute analysis of token ID registrants inwhich the number of registrants of token IDs is analyzed for eachattribute of the user U. In the upper part of the window, a button B21used for switching the statistics period of data between a yearly basis,a monthly basis, and a daily basis is displayed. In this example, amonthly basis is selected. Further, a button B22 used for switching thedisplay period is displayed next to the button B21. Further, in thecenter part of the window, the analysis results for each nationality,for each sexuality, for each seat class, for each airline, and for eachage are displayed in pie graphs, respectively. Note that not onlyattribute information but also an analysis result using boardinginformation (for example, an analysis result for each destination) maybe displayed.

FIG. 25 is a window for change in usage rate for each touch point inwhich the usage rate of biometric authentication is analyzed for eachtouch point. In the upper part of the window, an area selection buttonB31 used for selecting a touch point and a button B32 used for switchingthe statistics period of data between a yearly basis, a monthly basis,and a daily basis is displayed. In this example, a monthly basis isselected. Further, a button B33 used for switching the display period isdisplayed next to the button B32. In the center part of the window, therespective numbers of biometric authentication users (the number ofusers) at four touch points (the check-in lobby, the baggage drop-offsite, the security inspection site, and the boarding gate) are displayedin bar graphs, and respective usage rates of biometric authentication atthe four touch points are displayed in polygonal line graphs. Forexample, as the usage rate of biometric authentication, the ratio of thenumber of passengers actually using biometric authentication out of thenumber of passengers registering biometric information used for theboarding procedure (the number of passengers whose token IDs are issued)may be indicated. Further, the ratio of the number of passengers usingbiometric authentication out of the total number of passengers may beindicated.

FIG. 26 is a window for change in the authentication rate by touch pointin which the authentication rate (authentication success rate) ofbiometric authentication is analyzed for each touch point. In the upperpart of the window, an area selection button B41 used for selecting atouch point and a button B42 used for switching the statistics period ofdata between a monthly basis, a daily basis, and an hour basis isdisplayed. In this example, a monthly basis is selected. Further, abutton B43 used for switching the display period is displayed next tothe button B42. In the center part of the window, the total number ofauthentication targets in the security inspection site is displayed in abar graph, and the authentication rate of biometric authentication isdisplayed in a polygonal graph.

According to the present example embodiment, the management server 10can recognize the usage status of biometric authentication of the usersU from various points of view by statistically analyzing historyinformation (token ID information, passage history information,authentication history information, and operation information)registered in databases when the users U have performed respectiveprocedures at respective touch points based on biometric authenticationfor boarding airplanes. Accordingly, it is possible to facilitate use ofbiometric authentication in procedures at respective touch points.[Second Example Embodiment]

The information processing system 1 in the present example embodimentwill be described below. Note that references common to the referencesprovided in the drawings of the first example embodiment indicate thesame object. Description of features common to the first exampleembodiment will be omitted, and different features will be described indetail.

The present example embodiment is different from the first exampleembodiment in that the management server 10 further has a function ofcreating a learning model based on token ID information, passage historyinformation, authentication history information, and operationinformation, applying new data to the learning model, and performing asimulation of a throughput or a proposal of the optimal layout or numberof installations. That is, in the present example embodiment, the CPU101 of the management server 10 also functions as a learning unit and aprediction unit.

As one example of a learning method in the management server 10, ageneral deep learning framework such as TensorFlow, Caffe2, PyTorch, orthe like can be used for learning.

FIG. 27 is a schematic diagram illustrating a neural network used in alearning process in the present example embodiment. The neural networkillustrated in FIG. 27 has an input layer having a plurality of nodes,an intermediate layer having a plurality of nodes, and an output layerhaving a single node. For example, the number of passengers who havepassed through each touch point in a predetermined period, the number ofinstallations of terminals at each touch point at a procedure, a passagetime, and the like are input to each node of the input layer. Each nodeof the intermediate layer is connected to each node of the input layer.Each element of an input value input to a node of the intermediate layeris used for calculation in each node of the intermediate layer. Eachnode of the intermediate layer calculates a calculation value by usingan input value input from each node of the input layer, a predeterminedweighting coefficient, and a predetermined bias value, for example. Eachnode of the intermediate layer is connected to the output layer andoutputs the calculated calculation value to the node of the outputlayer. Calculation values from respective nodes of the intermediatelayer are input to the node of the output layer.

The node of the output layer calculates a processing time (estimationvalue) at each touch point by using calculated values input fromrespective nodes of the intermediate layer, a weighting coefficient, anda bias value. Note that, for example, a back propagation method is usedwhen a neural network is trained.

Specifically, an output value obtained when data is input to the inputlayer is compared with an output value obtained from training data, andan error resulted from the comparison is fed back to the intermediatelayer.

This is repeated until the error becomes below a predeterminedthreshold.

With such a learning process, when any number of passengers is input tothe neural network (learning model), a predicted processing time at eachtouch point can be output at high accuracy. Note that a learning modelcreated by the learning process is not limited to that described above.

FIG. 28 is a flowchart illustrating one example of the process in themanagement server 10. This process is performed in order that the systemmanager or the like recognizes the usage status of biometricauthentication in an airport.

First, the management server 10 acquires installation data of terminals(step S801) and acquires data of change in the number of passengers(step S802).

Next, the management server 10 performs a prediction process based on alearning model (step S803) and then outputs a prediction result (stepS804).

Next, the management server 10 references the prediction result anddetermines whether or not the predicted retention time of passengers ateach touch point exceeds a predetermined threshold (step S805). In thepresent example embodiment, the predicted retention time of passengersis considered to be the same as the predicted processing time of aterminal apparatus. Herein, if it is determined that the predictedretention time exceeds the predetermined threshold (step S805, YES), theprocess proceeds to step S806. Contrarily, if it is determined that thepredicted retention time does not exceed the predetermined threshold(step S805, NO), the process of FIG. 28 ends.

In step S806, installation data in which the number of installations ofterminals has been changed is applied to the learning model, and theprediction process based on the learning model is repeatedly performed.For example, the number of installations is decremented and input to thelearning model, and the number of installations when the predictedretention time corresponding to the number of passengers becomes lessthan the threshold is calculated.

The management server 10 then displays a proposal window to propose theoptimal number of installations and places (step S807) and ends theprocess of FIG. 28 .

FIG. 29 is a diagram illustrating one example of a window output by themanagement server 10. FIG. 29 is a proposal window to propose theoptimal number of installations of terminal apparatuses that performbiometric authentication. In the center part of the window, a proposalmessage based on the analysis process performed by the management server10 (“Passengers from country X are expected to increase significantly ina period from month M1 day D1 to month M2 day D2. Please install anotherN check-in terminal(s) in section AA of the check-in lobby.”) isdisplayed. Note that, in addition to such display, a map of the area ofinterest in an airport may be displayed, and a place for which thenumber of installations is proposed may be displayed with emphasis.

As described above, according to the present example embodiment, themanagement server 10 can create a learning model based on historyinformation on passengers and predict a predicted retention time(predicted processing time) of passengers in the airport based on thelearning model. Further, the management server 10 can propose the numberof terminal apparatuses which are to be installed at each touch pointand have a biometric authentication function based on the predictionresult.

Third Example Embodiment

FIG. 30 is a block diagram illustrating the whole configuration exampleof an information processing apparatus 100 in the present exampleembodiment. The information processing apparatus 100 includes anacquisition unit 100A and an output unit 100B. The acquisition unit 100Aacquires first history information indicating that a procedure relatedto boarding of a passenger in an airport was performed with biometricauthentication and second history information indicating that theprocedure was performed with reading of a medium. The output unit 100Boutputs the usage status of the biometric authentication in theprocedure based on the first history information and the second historyinformation. According to the information processing apparatus 100 inthe present example embodiment, it is possible to facilitate use ofbiometric authentication in procedures related to boarding ofpassengers.

MODIFIED EXAMPLE EMBODIMENTS

Although the present invention has been described above with referenceto the example embodiments, the present invention is not limited to theexample embodiments described above. Various modifications that may beappreciated by those skilled in the art can be made to the configurationand details of the present invention within the scope not departing fromthe spirit of the present invention. For example, it should beunderstood that an example embodiment in which a part of theconfiguration of any of the example embodiments is added to anotherexample embodiment or an example embodiment in which a part of theconfiguration of any of the example embodiments is replaced with a partof the configuration of another example embodiment is also one of theexample embodiments to which the present invention may be applied.

Further, the configuration of the present invention is applicable notonly to an international flight but also to a domestic flight. In thecase of a domestic flight, a 1:1 matching process between a passportface image and a captured face image in addition to an immigrationprocedure may be omitted. In such a case, for example, a captured faceimage at the time of purchasing a boarding ticket can be used as aregistered biometric image. When a terminal such as a smartphone or apersonal computer is used to purchase a boarding ticket or performcheck-in online, if a face image captured by a terminal is registered,the user can also board an airplane through face authentication at theairport A.

Although the check-in terminal 20 reads a passport face image from apassport and thereby issuance of a token ID is applied to the managementserver 10 in the first example embodiment described above, such issuancemay be applied to the automatic baggage drop-off machine 30 or thesecurity inspection apparatus 40 taking a case of an online check-inprocedure into consideration. That is, the management server 10 acquiresa passport face image and a target biometric image from any one of anoperation terminal that performs the operation related to the time ofdeparture of the user U. Issuance of a token ID may be applied in afirst performed procedure operation out of a series of procedureoperations performed at the time of departure. In such a case, theprocess in the automatic baggage drop-off machine 30 or the securityinspection apparatus 40 includes a step of acquiring recorded data froma passport and an airline ticket medium, a step of inquiring boardingreservation information from the reservation system 2, or the like inthe same manner as in the case of FIG. 14 .

Furthermore, the type of a statistics analysis process is not limited tothose described above. For example, analysis may be made for a series ofprocedures related to a certain user U. Specifically, the historyinformation may be acquired from the passage history information DB 12and the authentication history information DB 13, respectively, by usinga token ID of the user U as a key, and a procedure area (touch point)for which passage history information or authentication historyinformation is absent may be detected and analyzed. That is, when theuser U completes a procedure by reading of a recording medium such as aboarding ticket at some of the touch points, a touch point for whichpassage history information is present but authentication historyinformation is absent can be detected. For example, there may be a casewhere biometric authentication is used at the check-in lobby (touchpoint P1) and the baggage counter (touch point P2), then, biometricauthentication is not used at the security inspection site (touch pointP3), and biometric authentication is used at the immigration site (touchpoint P4) and the boarding gate (touch point P5), and the authenticationhistory at the touch point P3 is thus missed. Similarly, when theoperation terminals (22, 32, 42, 52, 62) are used to perform proceduresbut some registration process of passage history information is notperformed, a touch point for which both passage history information andauthentication history information are absent can be detected. It ispossible to recognize a traffic line of the user U by detecting andanalyzing such a missing state of records. As a result, it is alsopossible to change the layout or the number of installations of terminalapparatuses having a biometric authentication function and facilitatemore use of biometric authentication.

The scope of each of the example embodiments further includes aprocessing method that stores, in a storage medium, a program thatcauses the configuration of each of the example embodiments to operateso as to implement the function of each of the example embodimentsdescribed above, reads the program stored in the storage medium as acode, and executes the program in a computer. That is, the scope of eachof the example embodiments also includes a computer readable storagemedium.

Further, each of the example embodiments includes not only the storagemedium in which the program described above is stored but also theprogram itself.

As the storage medium, for example, a floppy (registered trademark)disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, amagnetic tape, a nonvolatile memory card, or the like can be used.Further, the scope of each of the example embodiments includes anexample that operates on OS to perform a process in cooperation withanother software or a function of an add-in board without being limitedto an example that performs a process by an individual program stored inthe storage medium.

The whole or part of the example embodiments disclosed above can bedescribed as, but not limited to, the following supplementary notes.

(Supplementary Note 1)

An information processing apparatus comprising: an acquisition unit thatacquires first history information indicating that a procedure relatedto boarding of a passenger in an airport was performed with biometricauthentication and second history information indicating that theprocedure was performed with reading of a medium; and an output unitthat outputs usage status of the biometric authentication in theprocedure based on the first history information and the second historyinformation.

(Supplementary Note 2)

The information processing apparatus according to supplementary note 1further comprising an issuance unit that issues a token ID correspondingto registered biometric information on the passenger used for thebiometric authentication,

wherein the first history information includes information on aprocedure area in which the registered biometric information wasregistered and the token ID, and

wherein the output unit outputs the number of registrations of theregistered biometric information for each procedure area.

(Supplementary Note 3)

The information processing apparatus according to supplementary note 2,

wherein the first history information includes attribute information onthe passenger, and

wherein the output unit outputs the number of registrations for eachattribute information.

(Supplementary Note 4)

The information processing apparatus according to supplementary note 2or 3, wherein the output unit outputs a usage rate of the biometricauthentication in the procedure area based on a ratio of the firsthistory information and the second history information for eachprocedure area.

(Supplementary Note 5)

The information processing apparatus according to any one ofsupplementary notes 2 to 4, wherein based on the token ID, the outputunit detects, out of a plurality of procedure areas, the procedure areafor which the first history information on the same passenger is absent.

(Supplementary Note 6)

The information processing apparatus according to any one ofsupplementary notes 1 to 5,

wherein the first history information includes terminal IDs of terminalsused in the biometric authentication and process results of thebiometric authentication, and

wherein the output unit aggregates and outputs the process results foreach of the terminal IDs.

(Supplementary Note 7)

The information processing apparatus according to supplementary note 6,wherein based on the process results for each of the terminal IDs, theoutput unit detects a terminal in which an authentication success rateis less than a predetermined threshold.

(Supplementary Note 8)

The information processing apparatus according to supplementary note 6or 7,

wherein the first history information further includes information onarrangement places of the terminals in the airport, and

wherein the output unit aggregates and outputs the process results foreach of the arrangement places.

(Supplementary Note 9)

The information processing apparatus according to supplementary note 8,wherein the output unit outputs information on an arrangement place inwhich average authentication accuracy obtained by averagingauthentication accuracy of the biometric authentication for each of thearrangement places is less than a predetermined threshold.

(Supplementary Note 10)

The information processing apparatus according to any one ofsupplementary notes 6 to 9 further comprising a prediction unit thatoutputs a predicted processing time in the procedure based on a learningmodel in which a relationship of the number of passengers in apredetermined period, the number of installations of terminals, and arequired time for the procedure is learned in advance.

(Supplementary Note 11)

The information processing apparatus according to supplementary note 10,wherein the prediction unit outputs information to facilitate a changeof the number of installations when the predicted processing timeexceeds a predetermined threshold.

(Supplementary Note 12)

The information processing apparatus according to any one ofsupplementary notes 1 to 11, wherein the output unit outputs differenttypes of statistics analysis results based on the first historyinformation and the second history information in a dashboard form.

(Supplementary Note 13)

An information processing method comprising: acquiring first historyinformation indicating that a procedure related to boarding of apassenger in an airport was performed with biometric authentication andsecond history information indicating that the procedure was performedwith reading of a medium; and outputting usage status of the biometricauthentication in the procedure based on the first history informationand the second history information.

(Supplementary Note 14)

A storage medium storing a program that causes a computer to perform:

acquiring first history information indicating that a procedure relatedto boarding of a passenger in an airport was performed with biometricauthentication and second history information indicating that theprocedure was performed with reading of a medium; and

outputting usage status of the biometric authentication in the procedurebased on the first history information and the second historyinformation.

REFERENCE SIGNS LIST

-   -   NW1, NW2 network    -   1 information processing system    -   2 reservation system    -   3 reservation information DB    -   10 management server    -   11 token ID information DB    -   12 passage history information DB    -   13 authentication history information DB    -   14 operation information DB    -   20 check-in terminal    -   30 automatic baggage drop-off machine    -   40 security inspection apparatus    -   50 automated gate apparatus    -   60 boarding gate apparatus    -   22, 32, 42, 52, 62 operation terminal    -   100 information processing apparatus    -   100A acquisition unit    -   100B output unit

1. An information processing apparatus comprising: a memory configuredto store instructions; and a processor configured to execute theinstructions to: acquire information of a device that acquiredregistered biometric information to be used for biometric authenticationin a procedure related to boarding of a passenger in an airport; andoutput the number of registrations of the registered biometricinformation for each procedure area where the device is provided.
 2. Theinformation processing apparatus according to claim 1, wherein theprocessor is configured to execute the instructions to: outputinformation related to a change in the number of registrations.
 3. Theinformation processing apparatus according to claim 1, wherein theprocessor is configured to execute the instructions to: acquire a tokenID corresponding to the registered biometric information; acquireattribute information of the passenger associated with the acquiredtoken ID by referring to a database that stores the attributeinformation and the token ID in association, and output the number ofregistrations for each attribute information.
 4. The informationprocessing apparatus according to claim 1, wherein the processor isconfigured to execute the instructions to: acquire history informationindicating that the procedure was performed with biometricauthentication; and output a usage rate of the biometric authenticationin the procedure area based on the history information for eachprocedure area.
 5. The information processing apparatus according toclaim 3, wherein the processor is configured to execute the instructionsto: detects, based on the token ID, the procedure area for which thehistory information on the same passenger is absent out of a pluralityof procedure areas.
 6. The information processing apparatus according toclaim 4, wherein the history information includes terminal IDs ofterminals used in the biometric authentication and process results ofthe biometric authentication, and wherein the processor is configured toexecute the instructions to: aggregate and output the process resultsfor each of the terminal IDs.
 7. The information processing apparatusaccording to claim 6, wherein the processor is configured to execute theinstructions to: detect a terminal in which an authentication successrate is less than a predetermined threshold based on the process resultsfor each of the terminal IDs.
 8. The information processing apparatusaccording to claim 6, wherein the history information further includesinformation on arrangement places of the terminals in the airport, andwherein the processor is configured to execute the instructions to:aggregate and output the process results for each of the arrangementplaces.
 9. The information processing apparatus according to claim 8,wherein the processor is configured to execute the instructions to:output information on an arrangement place in which averageauthentication accuracy obtained by averaging authentication accuracy ofthe biometric authentication for each of the arrangement places is lessthan a predetermined threshold.
 10. The information processing apparatusaccording to claim 6, wherein the processor is configured to execute theinstructions to: output a predicted processing time in the procedurebased on a learning model in which a relationship of the number ofpassengers in a predetermined period, the number of installations ofterminals, and a required time for the procedure is learned in advance.11. The information processing apparatus according to claim 10, whereinthe processor is configured to execute the instructions to: outputinformation to facilitate a change of the number of installations whenthe predicted processing time exceeds a predetermined threshold.
 12. Theinformation processing apparatus according to claim 1, wherein theprocessor is configured to execute the instructions to: outputsdifferent types of statistics analysis results form based on the historyinformation and other history information in a dashboard, wherein theother history information indicates that the procedure was performed byreading a medium.
 13. The information processing apparatus according toclaim 1, wherein the processor is configured to execute the instructionsto: acquire history information indicating that the procedure wasperformed with biometric authentication and other information indicatingthat the procedure was performed by reading a medium for each procedurearea when a plurality of the procedures for the boarding of passengersare carried out sequentially in a plurality of the procedure areas inthe airport; and output changes in the number of passengers and theratio of the passengers who used the biometric authentication for theprocedure during a predetermined period based on the history informationand other history information.
 14. An information processing methodcomprising: acquiring information of a device that acquired registeredbiometric information to be used for biometric authentication in aprocedure related to boarding of a passenger in an airport; andoutputting the number of registrations of the registered biometricinformation for each procedure area where the device is provided.
 15. Anon-transitory storage medium storing a program that causes a computerto perform: acquiring information of a device that acquired registeredbiometric information to be used for biometric authentication in aprocedure related to boarding of a passenger in an airport; andoutputting the number of registrations of the registered biometricinformation for each procedure area where the device is provided.